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CONSISTENCY OF THE JACKKNIFE-AFTER-BOOTSTRAP 
VARIANCE ESTIMATOR FOR THE BOOTSTRAP 
QUANTILES OF A STUDENTIZED STATISTIC 1 

By S. N. Lahiri 

Iowa State University 

Efron [J. Roy. Statist. Soc. Ser. B 54 (1992) 83-111] proposed a 
computationally efficient method, called the jackknife-after-bootstrap, 
for estimating the variance of a bootstrap estimator for independent 
data. For dependent data, a version of the jackknife-after-bootstrap 
method has been recently proposed by Lahiri [Econometric Theory 
18 (2002) 79-98]. In this paper it is shown that the jackknife-after- 
bootstrap estimators of the variance of a bootstrap quantile are con- 
sistent for both dependent and independent data. Results from a 
simulation study are also presented. 

1. Introduction. Bootstrap quantiles are frequently used for the purpose 
of constructing bootstrap-based confidence intervals (CIs). Like any other 
estimation procedure, the accuracy of the quantile estimators produced by 
the bootstrap method needs to be assessed. In his seminal paper, Efron [11] 
formulated the jackknife-after-bootstrap (JAB) method for estimating the 
standard errors of bootstrap quantities in the independent case. Recently, 
Lahiri [27] proposed a version of the JAB method for assessing the accuracy 
of block bootstrap estimators in the dependent case. In this paper we estab- 
lish theoretical validity of the JAB method for assessing the variability of 
bootstrap quantiles for both dependent and independent data. To describe 
the main results briefly, suppose that 9 is a population parameter and 9 n 
is an estimator of 6 that can be represented as a smooth function of sam- 
ple means. Let G n denote the block bootstrap estimator of the distribution 
function of a Studentized version of 6 n . See Section 2 for more details. Also, 
for a given a G (0,1), let G~ l {a) denote the a-quantile of G n . The main 
results of the paper show that, under some regularity conditions, and for 
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both dependent as well as independent data, 

(1.1) Var JA B(^n)/Var(^ n )^>l asn^oo 

for n = G n (x) and ip n = G~ l {a), where VarjAB(^n) is the JAB-estimator 
of the variance of <p n . Thus, the JAB variance estimators of the bootstrap 
distribution function and the bootstrap quantiles are consistent in the Stu- 
dentized case. 

For independent data, VarjAB(^n) is defined using the standard jackknife 
variance estimator formula (cf. [11]). In the dependent case, however, the 
definition of VarjAB^n) is slightly different from the usual block-jackknife 
variance estimator of (f) n . Here, instead of deleting blocks of observations 
directly, one deletes "blocks of bootstrap blocks" in the definition of the 
JAB variance estimator. This modification distinguishes the JAB in the de- 
pendent case from its i.i.d. counterpart and is crucial for computational effi- 
ciency (cf. [27]). Nonetheless, we show that consistency of the JAB variance 
estimator continues to hold in the dependent case. 

In the literature the JAB method has been employed in many impor- 
tant problems (cf. [8, 13, 21]), but without any theoretical justification. 
The main results of the paper provide theoretical justification for using the 
JAB method for estimating the variance of an important class of nonsmooth 
functionals of the bootstrap distribution for both dependent and indepen- 
dent data. Together with the results of Lahiri [27], they show that the JAB 
method can be effectively used not only to assess the variability of sim- 
ple functionals, like the bootstrap bias and variance estimators, but also to 
derive consistent estimates of standard errors for more complicated func- 
tionals, like bootstrap quantiles. These results are particularly important 
because of the extensive use of bootstrap quantiles in various bootstrap CIs, 
whose coverage accuracy critically depends on the accuracy of the quantile 
estimators, especially in the dependent case. Another notable application of 
the JAB method is recently given by Lahiri, Furukawa and Lee [29] who 
make use of the JAB variance estimators to construct a data-based method 
for selecting the optimal block size for block bootstrap estimation of various 
functionals, including block bootstrap quantiles. 

The main steps involved in the proofs of the main results are the deriva- 
tions of certain uniform Edgeworth and Cornish-Fisher expansions for the 
jackknife pseudo-values of the (block) bootstrap distribution function and 
quantile estimators, respectively. The technical arguments developed to prove 
these uniform expansions for the Studentized statistics in the dependent case 
may be of some independent interest. We also report the results from a small 
simulation study on finite sample properties of the JAB variance estimators 
in the dependent case. 

Properties of the jackknife and the bootstrap methods under indepen- 
dence have been studied by several authors; see Efron [9, 10], Miller [31], 
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Parr and Schucany [34], Shao and Tu [38], Shao and Wu [39] and the refer- 
ences therein. In his 1992 seminal paper, Efron formulated the JAB method 
for independent data and established its computational efficacy. The JAB 
method for dependent data was formulated by Lahiri [27]. Block bootstrap 
and block jackknife methods for dependent data have been put forward 
by several authors, notably by Hall [18], Carlstein [7], Kiinsch [22], Liu 
and Singh [30], Politis and Romano [35, 37] and Paparoditis and Politis 
[33]. Properties of block-bootstrap methods have been studied by Lahiri 
[23, 25, 26], Buhlmann [5], Naik-Nimbalkar and Rajarshi [32], Hall, Horowitz 
and Jing [20] and Gotze and Kiinsch [17], among others. 

The rest of the paper is organized as follows. In Section 2 we describe 
the basic framework of the paper and the JAB method for dependent data. 
Assumptions and the results on consistency of the JAB variance estimators 
are given in Section 3. Results from a simulation study are reported in 
Section 4. Proofs of the main results are given in Section 5. 

2. Preliminaries. For brevity, we concentrate our discussion on the de- 
pendent case and, as appropriate, point to the main differences for the inde- 
pendent case. In Section 2.1 we describe the basic framework of this paper 
and in Section 2.2 the JAB method. 

2.1. The basic framework. Let X\,X2, ... be a sequence of stationary 
random vectors (r.v.s) with values in M. d . For proving the results, we shall 
work under the "smooth function model" of Bhattacharya and Ghosh [1] 
(cf. [19]). Let 9 be a parameter of interest and let 9 n be an estimator of 9. Let 
X n = n~ l Ya=i Xi and [i = EX\. Then, the "smooth function model" pre- 
scribes that there exists a smooth function H : M. d — > M such that 9 n = H(X n ) 
and 9 = H(fi). Considering suitable transformations of the observations, one 
can treat a wide class of common estimators, including the generalized M- 
estimators of Bustos [6], under this model. See, for example, [19] and [28] 
for the scope of the "smooth function model" in the independent and the 
dependent cases, respectively. 

Note that, under the smoothness assumption on the function H, by the 
delta method, 

n 1 /\9 n -9)^N(0,rl), 

where — > denotes convergence in distribution and r^, = bim^oo n Var(/i(/n) / A > n ) 
denotes the asymptotic variance of 9 n . Here h denotes the d x 1 vector of first- 
order partial derivatives of H. Let f n {k) = rC 1 J27=i ~~ X n )(Xi + k — X n )' 
and let S n = f n (0) + Y^k=i{^n{k) + f n (k)'} for some integer t\. Then we 
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may use f 2 = \h(X n )'T, n h(X n )\ as an estimator of and define the Stu- 
dentized version of 9 n as 

(2.1) Tn = n y\e n -e)/{f n + n- 1 ). 

In the dependent case t\ goes to infinity suitably with the sample size n, 
while in the independent case we set t\ = for all n. We add the factor n" 1 
in the denominator of (2.1) to make T n well defined in the case when f n = 0. 

The sampling distribution and the quantiles of the Studentized statistic 
T n may be estimated by the bootstrap methods. For the dependent case, 
here we restrict attention to the moving block-bootstrap (MBB) method of 
Kiinsch [22] and Liu and Singh [30]. (See remarks at the end of Section 3 
for other block bootstrap methods.) Given X n = (X±, . . . ,X n ), define the 
blocks Bj = (Xj,..., X, +£ _i), j = l,...,N, where N = n - 1 +1 and I < £ < 
n denotes the block size. Let b= [n/£\ be the largest integer not exceeding 
nji. Then for the MBB method one selects a random sample B\ % •• 
from the collection {B±, . . . , Bn}- Arranging the components of Bf, ---,Bl 
into a sequence yields n\ = b ■ I bootstrap samples X* = {X^ , . . . , X* x }. For 
I = o(n) (which we assume in this paper), we get m/n— > 1 as n— > oo. Let 
= n \ l 2~^r=i X* denote the bootstrap sample mean and let fi n = E*X*, 
where E* denotes the conditional expectation given {X n } n >i. Then the 
bootstrap version of (9 n — 9) is given by (#* — 9 n ) with 9* n = H(X*) and 
9 n = H(fi n ). It is known (cf. [23]) that the "naive" approach of centering 9* n 
at 9 n leads to a worse performance of the resulting bootstrap approximation 
compared to centering at 9 n . 

Next, to define the MBB version of T n [cf. (2.1)], note that, conditional on 
X n , the resampled block sums S* = J2j=(i-i)£+i Xj are i-i-d. Hence, following 
Gotze and Kiinsch [17], we may use the sample variance of these block sums 
(with a suitable scaling) to define the Studentized version of 9* n . A "natural" 
analog of for the bootstrap case is thus given by 

< 2 ^jJz{KK)\s*-a* n )f. 

i=l 

Since the MBB resamples blocks with replacement from the observed blocks 
Bi, ... , Bn, it is possible that t* 2 = for certain values of X*, . . . , X* x (e.g., 
when all the resampled blocks B*,...,Bl are equal to B±, say). To avoid 
division by zero, we define the bootstrap version of T n as 

(2.2) r *^ n V^ : _^ /(r * +n -i). 

The inclusion of the term n _1 makes T* well defined when r* = 0. The effect 
of this modification on the accuracy of the bootstrap distribution function 
estimator is negligible up to the second order. 
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Next note that setting the block size 1=1 for all n, the MBB reduces to 
the standard bootstrap method of Efron [9] and T* of (2.2) also gives the 
bootstrap version of T n in the independent case. For both the dependent and 
the independent cases, the bootstrap estimators of the unknown distribution 
function and the quantiles of T n are, respectively, given by 

(2.3) fi ln = P*(T* <x), x£R 
and 

(2.4) <p 2n = ini{x:P*(T*<x)>a}, a e(0,l), 

where P* denotes conditional probability given {X n } n >i. Variances of these 
bootstrap estimators can be estimated by the JAB method, which we de- 
scribe next. 

2.2. J ackknife- after-bootstrap. The JAB method for dependent data ap- 
plies a version of the block j ackknife method to a block-bootstrap estimator. 
To describe the (block) jackknife method, let 7 n = g n (X n ) be an estimator 
of a parameter 7. For i = 1,...,N, define the ith jackknife block-deleted 
point value 7^ by = 9n-£{X n ,i), where X n ^ = X n \Bi denotes the set of 
data values after deleting the ith block. The block jackknife estimator of the 
variance of j n , based on blocks of size £, is given by (cf. [22, 30]) 

N 

(2.5) Var B j(7n) = (*(n - £)~ 1 )N~ 1 £(# - %) 2 , 

i=l 

where 7^ = £~ l {n^ n — (n — £)*fn ) is the ith pseudo-value of j n . Note that, 
if £ = 1, that is, if we delete a single observation at a time, the variance 
estimator of (2.5) reduces to its i.i.d. counterpart, 

n 

(2.6) Varj(7„) = (n(n - l))" 1 £(7^ - In?- 

i=i 

Now we are ready to define the JAB estimator of the variance of a block 
bootstrap estimator. Here, the jackknife pseudo-values for the JAB method 
are obtained by deleting "blocks of bootstrap blocks" at a time instead of 
deleting "blocks of original data values." This simple modification is im- 
portant, as it results in considerable computational efficiency (see [27] for 
details). Specifically, let (p n be the block-bootstrap estimator of (p n = (p(G n ) 
based on blocks of size £, where G n (-) = P(T n < ■) is the distribution func- 
tion of T n and (p is a functional, such as the quantile functional. Let m be 
an integer between 1 and N, and let M = N — m + 1. We define the JAB 
pseudo-values by deleting m consecutive blocks from the observed blocks 
{£1,..., Sat}. For i = l,...,M, define the set h = {1, . . . , N} \ {i, . . . ,i + 
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m — 1}. To define the ith jackknife block-deleted point value tpn , one needs 
to resample b blocks from the reduced collection {Bj :j £ Li\ and apply the 
functional ip to the resulting block-bootstrap estimator G n ^ of G n . More 
precisely, let Jn, . . . , be a collection of b random variables such that, con- 
ditional on {!„}„>!, they are i.i.d. with the discrete uniform distribution 
on Ij, that is, 

P* (Jn = i) = (N- my 1 for all j £ I { . 

Then the desired resampled blocks are given by {£>" = Bj tj :j = 1, . . . , b}. 
Let T* 1 denote the bootstrap version of T n based on the resampled values 
in the blocks {£>** : j = 1, . . . , b}. Let G n ^ be the conditional distribution of 

T* 1 (given {X n } n >i). Then, the ith jackknife block-deleted point value (pn 
is given by 

<P® = <p(d n j, i = i,...,M. 

The JAB estimator of the variance of (p n is defined as [cf. (2.5)] 

M 

(2.7) VarjAB(^n) = (m(N - m)" 1 ^" 1 - 0n)\ 

t=l 

where tp$ = m~ 1 (Nip n — (N — m)ipn). Thus, in the dependent case the JAB 
variance estimators of the bootstrap distribution function (p\ n and of the 
bootstrap quantile (p2n are defined using formula (2.7). In the independent 
case the corresponding JAB estimators are given by (2.7) by setting m = 
1 = 1 for all n> 1 (cf. [11]). 

In the next section we show that, under some regularity conditions, the 
JAB variance estimators are consistent. 

3. Main results. In a seminal paper Gotze and Hipp [15] obtained Edge- 
worth expansions for sums of dependent random vectors under some fairly 
general conditions. For the dependent case, we shall establish the consis- 
tency of VarjAB(^fcn)) k = 1, 2, under a similar framework. To this end, sup- 
pose that X±,X2,--- are defined on a common probability space (Q,J-,P) 
and a sequence T>o,V±i,V±2, ■ ■ ■ of sub-cr-fields of T is given. Let |x| = 

I x\ | H \-\xd\ and ||x|| = (x\-\ ha^) 1 / 2 , respectively, denote the i 1 and £ 2 

norms of x = (x±, . . . , Xd)' £ Also, for a vector u = (i>\, . . . , v&)' G Z+, let 
D v denote the fth order partial derivative operator d Ul ~^ *~ Vd /dx'i ■ ■ ■ dx^ d , 
where Z+ = {0,1,2, .. .}. 

3.1. Assumptions. We shall make use of the following assumptions to 
prove the results: 
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(A. 1) H : M. d — > R is four-times continuously differentiable and for all v G 

H=4, 

|Z^F(x)| <C(l + ||x|| a ), x G M. d , 

for some integer a > 1 and C G (0, oo). 
(A. 2) There exists 5 > such that, for all n, k = 1, 2, . . . with fc > 5 , there 
exists a PlT^-measurable cl-variate random vector X n % such that 

E\\X n -X ntk \\<5^e^ V {-5k). 
(A. 3) There exists 5 > such that, for all ra, fc = 1, 2, . . . ,A G G 

n J3) - P(A)P(B)\ < <T 1 exp(-Sk). 

(A. 4) There exists 5 > such that, for all n,k,r = 1,2,... and A G T^n-r^ 

E\P(A\Vj :j^n)- P(A\Vj : < \n - j\ < k + r)\ < (T 1 exp(-6k). 

(A. 5) There exists 5 > such that, for all n,k = 1,2, ... , d^ 1 < k <n, and 
for alHGM p with ||t|| >6, 

E\E(exp(V=it'(X n - k + ■■■ + X n+k ))\Vj-.j ^n)\<e- S . 

(A.6) g E||Xi|| 29+<5 < 00 for some 5 > 0, where q G Z + . 

Formulation of assumptions (A.2)-(A.5) in terms of the cr-fields Dj, instead 
of the random vectors Xj themselves, is to provide more flexibility in verifica- 
tion of the assumptions and to extend the range of applicability of the results. 
Choosing Dj = a(Xj), the cr-field generated by Xj, renders the verification 
of (A. 2) rather trivial, but makes the verification of the conditional Cramer 
condition (A. 5) quite difficult. In a specific problem, a different choice of Vj 
(from cr(Xj)) is often more suitable for verifying (A.2)-(A.5). For example, 
if Xj = J2h=-oo c kYj-k for some sequence of i.i.d. random vectors {Yj} and 
constants {cj}, then a natural choice of T>j is cr(Yj), rather than a{Xj). We 
refer the interested reader to [4] and [15, 16], where conditions (A.2)~(A.5) 
are verified for a number of important dependent models. 

Next we comment on the moment condition (A.6) 9 , which is used with 
different values of q in the results below. For the distribution function case, 
we use (A.6)g primarily for establishing valid expansions for the variance of 
the bootstrap distribution function estimator <p\ n . Essentially this requires 
establishing uniform integrability of the reciprocal of f* and of E*(\\X* \\ 5p ) 
for suitable integers k > 1, p > 1, where f 2 = n\ Var ^ (h(fL) 1 X*). Our con- 
ditions are comparable to the moment conditions used in similar contexts 
(cf. [2]). For the quantile case, we need a stronger moment condition than 
for the distribution function case. Note that (p\ n , being the probability of 
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an event, is always bounded by 1, while the bootstrap quantile (p2n can be 
very large when either the numerator of T* is large or its denominator is 
small. The higher moment condition for the quantile case results from mak- 
ing the L 2 -norm of ip2n over certain low-probability pathological sets small. 
The moment condition can be somewhat reduced if we restrict the range of 
possible values of the block size I and the jackknife- variable m in Theorems 
3.1 and 3.3. However, we do not pursue such refinements here. 

3.2. Distribution function. The first result deals with the JAB variance 
estimator of the block bootstrap distribution function G n (x) of T* at a point 
x = xq £ R. 

Theorem 3.1. Suppose that assumptions (A.1)-(A.5) and (A.6) g hold 
with q = 31. Also, suppose that n K < t < k" 1 ?! 1 / 3 and that m~ 1 £ 1+K + mn~ 2 / 3 = 
o(l) as n — ► oo for some k > 0. Then, for any xq € R, 

(3.1) VarjAB(^in)/Var(<£i n )-^l as oo, 
where (p\ n = P*(T* < xq) and T* is as defined in (2.2). 

Thus, Theorem 3.1 shows that, for a wide range of values of the block size 
I and "blocks of blocks" jackknife variable m, the JAB variance estimator is 
consistent for the MBB distribution function estimator (pi n = P*(T* <xq). 
In particular, the JAB variance estimator of (p\ n is consistent when the MBB 
block size i goes to infinity at the optimal rate Cn 1//4 , C G (0, oo) (cf. [20]). 

A consistency result similar to Theorem 3.1 also holds for Efron's [11] 
JAB variance estimator in the i.i.d. case. To state it, let Xjk denote the kth 
component of Xj, j>l,l<k<d. Let Vj be a d + [d(d + 1) /2] -dimensional 
random vector with the first d components given by Xj and the remaining 
[d(d + l)/2] components given by {Xj p Xj q : 1 < p < q < d}. Then we have 
the following result. 

Theorem 3.2. Assume that X\,X2, ■ ■ ■ are i.i.d. random vectors in M d 
satisfying the following version of the Cramer condition: 

(3.2) limsup|£exp(it'Vi)| < 1. 

||t||— >oo 

//, in addition, assumptions (A.l) and (A.6) 9 hold with q = 20, then for any 
x ER, 

VarjAB(^in)/ Vax(<£ ln ) ^> 1 

as n — > oo, where (p\ n = P*(T* <xo), and T* and VarjAB( - ) are, respectively, 
defined by (2.2) and (2.7) with l=\ and m = 1 for all n > 1. 
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Thus, the original version of the JAB variance estimator, proposed by 
Efron [11] for independent r.v.s, is also consistent for the distribution func- 
tion estimator obtained by Efron's [9] bootstrap method. Note that in the 
independent case the variance of the bootstrap distribution function estima- 
tor ipi n goes to zero at a faster rate, namely 0(n -2 ), than that of the block 
bootstrap estimator. Therefore, the JAB variance estimator adapts itself 
to this higher accuracy level of the bootstrap estimator in the independent 
case. 

A comparison of the regularity conditions for Theorems 3.1 and 3.2 shows 
that the moment condition used for the independent case is somewhat 
weaker than that in the dependent case. To see why, observe that, for 
the bootstrap method of Efron [9], the second- and higher-order terms in 
the Edgeworth expansions of the bootstrap estimator Cp\ n and its jackknife 
pseudo-values are smooth functions of certain sample means. However, in 
the dependent case these terms in the Edgeworth expansions are given by 
functions of "sums of block-sums" which, due to their more complicated 
forms, lead to the higher moment requirement. Next consider the Cramer 
conditions for Theorems 3.1 and 3.2. In the independent case we need to 
assume the Cramer condition (3.2) on a second degree polynomial V\ of 
X\. This is because the stochastic expansion for the Studentized statistic 
T* is given by a smooth function of a similar quadratic function of the 
resampled bootstrap variables Xj . However, in the dependent case the cor- 
responding stochastic expansion is given by a function of certain quadratic 
forms in the resampled block sums. Since the block length tends to infinity, 
the block sums approximately behave like a normal random vector, and an 
analog of the Cramer condition (3.2) is essentially ensured by (A. 5). As a 
result, for the dependent case we do not need to make such an assumption 
on the quadratic function of the Xj's separately. 

3.3. Bootstrap quantiles. In this section we consider the JAB estimator 
of the variance of a bootstrap quantile. Theorem 3.3 below asserts the con- 
sistency of the JAB variance estimator of the block bootstrap quantile (f>2n 
in the dependent case. 

Theorem 3.3. Suppose that assumptions (A.1)-(A.5) and (A.6) g hold 
with q = max{60, 12(2 + a)} + 1, where a is as in (A.l). Also, suppose that 
n K < I < k -1 ??, 1 / 3 and that m~ 1 £ 1+fi + mn" 2 '' 3 = o(l) as n — > oo for some 
K > 0. Then, for any a € (0, 1), 

(3.3) Var JA B(^2n)/Var(^2n)^l as tw oo, 

where (pi n = inf{x G R : P*(T* < x) > a} and T* is as defined in (2.2). 
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Thus, it follows that, under fairly general conditions, the JAB estimator 
of the variance of an MBB quantile is consistent. In the literature on jack- 
knife for independent r.v.s, a modification of the standard jackknife method, 
called the "delete-d" jackknife, is often used to produce a consistent esti- 
mator of the variance of the sample quantile. However, the consistency of 
the JAB variance estimator of a block bootstrap quantile is not merely an 
artifact of deleting blocks of blocks, as follows by considering the i.i.d. case. 
Indeed, for independent data, the jackknife part of the JAB method deletes 
only one observation at a time and the consistency of the resulting vari- 
ance estimator for a bootstrap estimator continues to hold, as shown by the 
following theorem. 

Theorem 3.4. Assume that Xi,X%, . . . are independent M. d -valued r.v.s 
satisfying the conditions of Theorem 3.2 and that -E||A"i|| p < oo for p = 
max{75, 4(4 + 2a)}. Let (p2 n and VarjAB(^2n) be, respectively, defined by 
(2.4) and (2.7) with 1=1 and m = l for all n> 1. Then (3.3) holds. 

Thus, under the regularity conditions of Theorem 3.4, the JAB variance 
estimator of a bootstrap quantile is consistent. As it is well known, the 
standard (delete-1) jackknife method fails drastically in variance estimation 
problems involving the sample quantile and other nonsmooth functionals of 
the empirical distribution function. However, the JAB variance estimator, 
which also applies the delete-1 jackknife method to a bootstrap quantile esti- 
mator under independence, effectively overcomes this inconsistency problem. 
This appears to be a striking property of the JAB method and highlights 
the marked contrast between the properties of the JAB method and the 
standard jackknife method. 

Remark 3.1. A version of the JAB method for the nonover lapping block 
bootstrap (NBB) method (cf. [7, 28]) was described in [27]. Consistency of 
the JAB variance estimators for the NBB distribution function estimators 
and the NBB quantile estimators continues to hold solely under the condi- 
tions of Theorems 3.1 and 3.3, respectively. A similar remark also applies to 
the JAB variance estimators of bootstrap estimators based on the Circular 
Block Bootstrap method of Politis and Romano [35] . 

Remark 3.2. In many applications involving dependent data, block 
bootstrap estimators are used with data-based choices of £. Although the 
consistency results proved in here are not directly applicable to such cases, 
the following observation may be worth noting. Suppose that the JAB vari- 
ance estimator is applied to a bootstrap estimator with an estimated block 
size I and that I takes values in an interval of the form 
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with probability one, for some positive constants C\,Ci G (0,1). (Here n 1 / 4 
is the optimal order of the block size for estimating (pi n , <p2n-) I n this case one 
can refine the arguments of the paper to establish uniform versions of the 
consistency results of Theorems 3.1 and 3.3 over the interval L. As a result, 
when the JAB method is employed with such estimators of the block size, the 
corresponding JAB variance estimator is expected to estimate the additional 
variability in the bootstrapped estimators (fj n (£), j = 1,2, consistently. 

4. Numerical results. In this section we report the results from a sim- 
ulation study conducted to investigate finite sample properties of the JAB 
method and the choice of the JAB smoothing parameter m in the dependent 
case. For results under the independent case, see Efron [11], Hill, Cartwright 
and Arbaugh [21] and the references therein. For the simulation study, we 
considered four different time series models, given by: 

(I) X t = (s t + 8 t+1 )/V2, 
(II) X t = 0.3X t „ l + e t , 

(III) X t = -0.1X t _ 1 +e t , 

(IV) X t = W? + W t t{W t < 0), with W t = 0.6W t _i - 0.3W t _ 2 + 0.1W t _ 3 + 
e t + 0.2e t _! + 0.3 ei _ 2 + O.lej-s, 

where, in (I)-(IV), {et} is a sequence of i.i.d. N(0, 1) random variables. 
Thus, model (I) is a moving average (MA) model of order 1, models II and 
III are autoregressive (AR) models of order 1, with a positive and a negative 
autoregression parameter, respectively, and model (IV) is an instantaneous 
transformation of an ARMA(3, 3) model. The marginal distribution of the 
AVs under the first three models is symmetric, but under model (IV), it 
is asymmetric (with a thicker right tail). For each of the models (I)-(IV), 
we considered two sample sizes n = 125,800 and applied the MBB with the 
block lengths £ = 5 and £ = 8, respectively, to estimate three population 
parameters: (i) (p\ n = P(T n < 0), the distribution function of T n at 0, (ii) 
ip2n = the 0.35 quantile of T n and (iii) (p^ n = the 0.80 quantile of T n . The 
corresponding MBB estimators are given by 

ip ln = P*(T*<0), 

(4.1) (p2n = 0.35 quantile of T*, 

¥?3n = 0.80 quantile of T*, 

where T* is as in (2.2). Here the parameters of interest for the JAB method 
are given by Var((^. n ), k = 1,2,3. Table 1 gives the true values of Var(^ n ) 
obtained by 20,000 simulation runs for each model. For each simulated data 
set, K = 1000 bootstrap replicates were used to compute the bootstrap es- 
timators (pkn- Next we applied the JAB method to estimate the variances 
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of the MBB estimators (f>kn- As in [27], we considered several values of the 
jackknife block length m using the formula 

(4.2) m = Cn 1/3 £ 2/3 

for different constants C. An intuitive explanation for the choice of m in (4.2) 
may be given as follows. Note that the JAB applies a version of the moving 
block jackknife method to the MBB estimator (p^n by deleting "blocks" of 
m overlapping blocks. Since (i) the MSE-optimal block length for the block 
jackknife variance estimator (cf. [20, 22]) for a sample of size J is of the form 
C ■ J 1 / 3 and (ii) there are b = [n/£\ many "approximately independent" 
nonoverlapping blocks of length £ in a sample of size n for a block bootstrap 
estimator based on nonoverlapping blocks of length £, the optimal jackknife 
block length for its jackknife variance estimator is of the form C ■ b 1 ^ 3 . But 
there are approximately C ■ fr 1 / 3 ^ overlapping blocks contained in C ■ 6 1 / 3 
nonoverlapping blocks and vice versa. Hence, for a MBB estimator based on 
overlapping blocks of length £, one should delete C ■ b l / 3 £ overlapping blocks 
to define the JAB variance estimator. Formula (4.2) now follows by noting 
that C ■ b 1 / 3 £ is asymptotically equivalent to Cn l / 3 £ 2 / 3 . 

We applied the JAB method with the above choice of m for C = 0.1, 0.5, 1.0. 
Table 2 gives the bias, the standard deviation (sd) and the mean squared 
error (mse) of the JAB estimators of Var(c/3fc n ) under models (I)-(IV). The 
results are based on 1000 simulation runs in each case. For each simula- 
tion run the number of bootstrap replicates was K = 1000. We make the 
following observations on the results of Table 2. 

(1) For all four models and for all three parameters Var(0fc n ), k = 1,2,3, 
the mse's of the JAB estimators decreased as the value of C is decreased. 
The best performance is attained at C = 0.1 in each case. 

(2) There seems to be little effect of asymmetry of the marginal distribu- 
tion of Xt on the choice of C in (4.2). 

Table 1 

The true values of the target parameters Var(</3fc n ), fc = 1,2,3, for models (I)-(IV) based 
on 20,000 simulation runs. The MBB estimators ipknS are defined by (4.1) with 



M 


= (125,5) and I 


[n,£) = (800 


, 8) . For each data set, K = 
were used 


1000 bootstrap 


replicates 




n 


= 125, £ = 


5 




n = 800,1 = 8 




Model 


Var(<£i„) 


Var(<^2n) 


Var((^3r l ) 


Var(<^i„) 


Var(<^2n) 




(I) 
(II) 

(HI) 
(IV) 


2.051e-4 
1.846e-4 
1.837e-4 
1.870e-4 


2.219e-3 
1.351e-3 
1.297e-3 
1.348e-3 


1.956e-3 
2.292e-3 
2.098e-3 
2.272e-3 


1.715e-4 
1.688e-4 
1.708e-4 
1.748e-4 


1.226e-3 
1.232e-3 
1.240e-3 
1.295e-3 


1.363e-3 
1.345e-3 
1.350e-3 
1.377e-3 
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Table 2 

Bias, standard deviation (sd) and mean squared error (mse) of the JAB variance 
estimators of the MBB estimators Cpkn, k = 1, 2, 3, of (4.1) under models (I)-(IV), where 
the jackknife parameter m is chosen according to the formula m = Cn 1//3 £ 2 ^ 3 with 
different values of C . The results are based on 1000 simulation runs in each case. The 
value of K is the same as in Table 1. An asterisk "*" indicates the minimum value of 

the mse 



n = 125,£ = 5 n = 800,£ = 8 



C = 0.1 C = 0.5 C — 1.0 C = 0.1 C = 0.5 C = 1.0 

Model (I) 



Var(<pi„) 


bias 


1.235e- 


4 


8.963e- 


3 


2.265e- 


2 


2.856e- 


4 


3.626e- 


:i 


7.520e- 


3 




sd 


1.421e- 


5 


1.427e- 


3 


7.205e- 


3 


1.993e- 


5 


4.891e- 


4 


1.606e- 


3 




mse 


1.546e- 


-8* 


8.237e- 


5 


5.648e- 


4 


3.825e- 


6* 


6.276e- 


4 


2.902e- 


3 


Var((^2n) 


bias 


2.407e- 


4 


7.054e- 


2 


0.1992 




1.865e- 


3 


2.476e~ 


2 


5.244e- 


2 




sd 


6.466e- 


4 


1.988e- 


2 


9.574e~ 


2 


5.873e~ 


4 


3.791e- 


3 


1.233e- 


2 




mse 


4.760e- 


7* 


5.372e- 


3 


4.885e- 


2 


3.825e- 


6* 


6.276e- 


4 


2.902e- 


3 


Var(<p 3n ) 


bias 


5.825e- 


5 


5.643e- 


2 


0.1609 




1.511e- 


3 


2.215e- 


2 


4.707e- 


2 




sd 


5.501e- 


4 


1.173e- 


2 


6.997e- 


2 


6.017e- 


4 


3.303e- 


3 


1.085e- 


2 




mse 


3.060e- 


7* 


3.322e-3 


3.078e- 


2 


2.646e- 


6* 


5.016e- 


4 


2.333e- 


3 


Model (II) 




























Var(ipi„) 


bias 


1.445e- 


4 


8.984e- 


3 


2.291e~ 


2 


2.897e~ 


4 


3.705e~ 


3 


7.770e- 


3 




sd 


1.564e- 


5 


1.391e- 


3 


7.425e~ 


3 


1.973e~ 


5 


5.016e- 


4 


1.669e- 


3 




mse 


2.113e- 


-8* 


8.264e- 


5 


5.802e- 


4 


8.435e- 


-8* 


1.398e- 


5 


6.316e- 


5 


Varf (bo™ ) 


bias 


7.667e- 


4 


6.030e- 


2 


0.1706 




1.848e- 


3 


2.516e- 


2 


5.435e- 


2 




sd 


5.093e- 


4 


1.071e- 


2 


6.569e- 


2 


5.542e- 


i 


3.885e- 


3 


1.284e- 


2 




mse 


8.471e- 


7* 


3.751e- 


3 


3.342e- 


2 


3.724e- 


6* 


6.484e- 


4 


3.119e- 


3 


Var(^ 3n ) 


bias 


2.142e- 


5 


6.168e- 


2 


0.1750 




1.583e- 


3 


2.268e- 


2 


4.869e- 


2 




sd 


6.714e- 


4 


1.146e- 


2 


6.560e- 


2 


5.877e~ 


4 


3.424e~ 


3 


1.120e- 


2 




mse 


4.512e- 


7* 


3.936e- 


3 


3.493e- 


2 


2.851e- 


6* 


5.264e- 


4 


2.496e- 


3 


Model (III) 




























Var((^i„) 


bias 


1.447e- 


4 


7.617e- 


3 


1.883e- 


2 


2.631e- 


4 


3.393e- 


3 


7.126e- 


3 




sd 


1.538e- 


5 


1.294e- 


3 


6.270e- 


3 


2.098e- 


5 


4.730e- 


4 


1.542e- 


3 




mse 


2.117e- 


8* 


5.970e- 


5 


3.939e- 


4 


6.971e- 


-8* 


1.174e- 


5 


5.316e- 


5 


Var((^2n) 


bias 


8.643e- 


4 


5.075e- 


2 


0.1352 




1.721e~ 


3 


2.298e- 


2 


4.968e- 


2 




sd 


5.573e- 


4 


9.881e- 


3 


5.050e- 


2 


5.738e~ 


4 


3.745e- 


3 


1.214e- 


2 




mse 


1.058e- 


6* 


2.673e- 


3 


2.083e- 


2 


3.292e- 


6* 


5.421e- 


4 


2.616e- 


3 


Var(<p 3n ) 


bias 


1.988e- 


4 


5.149e- 


2 


0.1383 




1.394e- 


3 


2.058e- 


2 


4.453e- 


2 




sd 


6.448e- 


4 


1.032e- 


2 


5.247e- 


2 


5.874e- 


4 


3.169e- 


3 


1.040e- 


2 




mse 


4.553e- 


7* 


2.758e- 


3 


2.188e- 


2 


2.289e- 


6* 


4.336e- 


4 


2.091e- 


3 


Model (IV) 




























Var((,5i n ) 


bias 


1.415e- 


4 


8.977e- 


3 


2.341e- 


2 


2.713e~ 


4 


3.528e- 


3 


7.375e- 


3 




sd 


1.507e- 


5 


1.382e- 


3 


7.598e- 


3 


1.929e- 


5 


4.962e- 


4 


1.595e- 


3 




mse 


2.025e- 


-8* 


8.249e- 


5 


6.056e- 


4 


7.400e- 


-8* 


1.269e- 


5 


5.694e- 


5 


Var(<p 2 n) 


bias 


8.130e- 


4 


6.014e- 


2 


0.1745 




1.804e- 


3 


2.451e- 


2 


5.238e- 


2 




sd 


5.165e- 


4 


1 .054e 


2 


6.565e- 


2 


6.083e- 


4 


4.092e- 


3 


1.272e- 


2 




mse 


9.277e- 


7* 


3.728e- 


3 


3.476e~ 


2 


3.625e- 


6* 


6.177e^ 


4 


2.905e- 


3 


Var((,53 n ) 


bias 


7.782e- 


5 


6.204e- 


2 


0.1785 




1.434e- 


3 


2.125e~ 


2 


4.579e- 


2 




sd 


7.051e- 


4 


1.177e- 


2 


6.7749e-2 


6.044e- 


4 


3.377e^ 


3 


1.073e- 


2 




mse 


5.032e~ 


7* 


3.988e- 


3 


3.646e- 


2 


2.424e- 


6* 


4.630e- 


4 


2.212e- 


3 
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(3) As expected, there is indeed some effect of the arguments x and a 
on the relative magnitudes of the mse's of the block bootstrap estimators 
G n (x) = P*(T* < x) and G~ l (a). For C = 0.1, n = 125 and i = 5, the mse 
of the JAB variance estimator of (p\ n is the least, followed by those of (f>2 n 
and (psm in all four models. Although it is uniform across the four models 
and possibly of secondary interest, a different pattern exists for C = 0.5 and 
C = l. 

(4) The choice C = 0.1 yields the best result for both combinations of the 
sample size and block length, (n,£) = (125,5) and (800,8). It is somewhat 
surprising that, despite having a larger sample size, the least mse values for 
the (n,£) = (800,8) case with C = 0.1 are consistently larger than those for 
the (n,£) = (125,5) case. This seems to be an artifact of the effects of the 
block size £ and the choice of m through (4.2). 

(5) When the results of this section are compared with the simulation 
results of Lahiri [27] on the choice of m for the variance functional, a pro- 
nounced effect of the functional type on the value of C is noticeable. It 
appears that, for the variance functional, a larger value of C (C > 1) is de- 
sirable, whereas the value of C should be small for the bootstrap distribution 
function and quantile estimators. 

5. Proofs. We begin with some notation to be used in the rest of the 
paper. Let 1a and 1(A) denote the indicator function of a set A, and 
for any countable set J let |J| denote the number of elements in J. Let 
g : [0, oo) — > [0, oo) be an increasing function such that g(t) = t if t < l,g(t) = 
2 for t>2, and g(-) is Lipschitz on [0,oo). For c > 0, define the truncation 
function g c (-) : R d -> R d by g c (x) = cxg(\\x\\/c)/\\x\\,x G R d . For a£Zf, set 

al = 1X7=1 a j an d \ot\ = OL\ + h Let $ and </>, respectively, denote the 

distribution function and the density of a N(0, 1) random variable. 

Next we collect the definitions of the random vectors that appear in the 
proofs below. For the sake of brevity, in this section we adopt the convention 
that, unless otherwise stated, the index i runs over the set {0, 1, ... , M}, j 
over {1, . . . , 6} and k over N = {1, 2, . . .}. In the definitions below, we shall 
use the index i = to define quantities that are related to the original block 
bootstrap variables (i.e., when no blocks are deleted). Thus, we set 1$ = 
{!,-■■ ,N} for the index set of all observed blocks and Bj° = B* for j e Iq. 
With this convention, the resampled observations in the blocks {B*j l : j = 
1, . . . , b} are denoted by Xf , . . . , X* n \ (for all i = 0, 1, . . . , M). Next define 

U k = (X k + • • ■ + X k+e ^)/£, U lk = U k £^ 2 , 

Uf = (Xf + ■■■ + Xf +l _ x )/£, U$ = U* l £ 1/2 . 

Let W%!j (and W2k) denote the d(d+ l)/2-dimensional vector consisting of 
the diagonal and the subdiagonal elements of the dx d matrix U^-U*j (and 
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of U lk U[ k , resp.). Next define U$j = (U$;W%'y and U 2k = (U[ k ;W^ k )' . Let 
d = d + d(d+ 1) /2. For t G M do , let u; in (t) = exp(^Tt / C/ 2 *|) and w t {t) = 
Eexp(y/=lt?U2i). For a E Z d + , set c« = D a H(n)/a\ and c aji = D a H(fi n ,i)/a\. 
Let C/f = C/f - j± n>u U;i = - E*U%,r = 1, 2. 
Next define the covariance matrices 

S n i = E^U^lU^l , = EU21U21, Sqo = lim S^j 

f^i = Ejj$U$ and rli = E^) 2 , 

where = 1$ - E^Y^j and y« = £ H=1 M^j)" Also, let f| = - 
fli, Y* = E^iCaAKT/V^i, Z*J = ^(^ - An) and z« = 6-V2 x 
T, b j=iU* l j, r = 1,2. Note that Z« = Zj*. Let Z n = n 1 / 2 ^ - fi) and let 
Zqo denote a random vector with the iV(0,£oo) distribution on ]R rf . Define 
the vector Z2 j00 from Z^ in the same way U21 is defined from U\\. 
Next define the variables 

and 

*ft= E[M7)K#) 7 , 

l7l=l 

where ^(7) = 2£ H=1 £ |/?1=1 c a ,i^ +1 ,0 + i)\E m {j^) a {jj^{f . Let r\\ = 
E H =iC a (Utir, T lk = £ w=1 c Q [/«, U®(a) = E,(U&) a and ft® = 
E*(Uf{) a - EUR. Also, write U^{a) = [NU{f(a) - (N - m)uj$]/m for 

" (i) 

the ith jackknife pseudo- value corresponding to C/ ln , 1 < i < M. For nota- 
tional simplicity, we often drop from the subscripts and superscripts of 
the above variables for the case i = and use both interchangeably, such as 
U* = U*°, U*j = U$ and c aj0 = c a , and so on. 

In the proofs below, unless otherwise stated, we set /i = 0. We will use C, C(-) 
to denote generic constants, depending on their arguments (if any), but 
not on i,n,£ and m. For notational simplicity, any such dependence on 
population quantities, like ||H~ , || or that remain fixed through- 

out the proof of a result, will be suppressed. Similarly, let Aj(x),j > 1, 
denote generic polynomials (with numerical coefficients) in multivariables 
x E , 1 < kj < 00, that do not depend on n,£,m and i. Unless otherwise 
specified, limits in order symbols are taken letting n — > 00. 

Lemma 5.1. Let f :M. d — > K. be a differentiate function such that 
max{\D"f(x)\:\i/\ =0,1} < M(/)(l + \\x\\ s ), x E R d , for some s E [0,oo) 
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and for some M(f) > 1. Assume that 4(logn) 2 < I < n 1 / 2 , £ < m < n/4, and 
that (A. 2) and (A. 3) hold. Then for any integer r > 1, 

S(^/M)-^/(^ii)) ar <C'(r, S) d,J)[M(/)] 2r |/ i |- r r 

uniformly in i E {0, 1, . . . , M}, provided E\\X± \\ 2 i +s < oo for some 5 > and 
/or some integer q satisfying q> sr if s > and g > if s = 0. 

Proof. We prove the lemma for "s > 0" only. The case "s = 0" is sim- 
pler and can be proved using like arguments. For c > 0, let f c (-) = f(g c (-))- 
Then, with c = n r , by Holder's inequality, 

E\(E,f(V$) - Ef(U u )) 2r - (E*f c (UZ{) - ^/ c (C/ii)) 2r | 

< C(r)E{\(E,f(U£) - E*f c (U{[)) - (Ef(U u ) - Ef c (U n ))\ 

x (\E*f(U%) - EfiUu)] 2 "- 1 + \E.f c (U$) - EMUn)^- 1 )} 

< Cirm- 1 ^(M(/)) 2 ^{(1 + \\U n \\'){l + \\Ui i \\ a f r - 1 t[\\U lx \\ > c)} 

+ C(r)(M(/)) 2r {£(l + ||J7ii[| s )IL(||C7 11 [| > c)} • + ||C/n ||') 2 »- 1 

< C(r)(M(/)) 2r c-^(l + ||£/ii|n 2r+<5 

<C(r,M)(M(/)) 2r n"'-. 

Next we approximate -Xj's with Xj ^'s. Let C/ij and JTfl's be defined by 
replacing X,'s in the definitions of Uu and C/jI's with Xj^ u ,u = (logn) 3//2 . 
Then, using (A. 3), it is easy to check that 

\E(E*f e (U&) - Ef c (U 11 )f r - E(E*f c (UZ{) - Ef c (Un)? T \ 
<C(r,s,d,5)[M(f)] 2r n- r . 

Let Ki be the integer satisfying (Ki - 1)21 < < 2£Ki. With l<k< K h 
let S(k,i) denote the sum of all fjfixj) for j G [(fe- 1)2£+ 1, A;2£] nij. Noting 
that the -X} |U 's defining S(k,j) and <S(/c + 2,j) are separated by a block of 
length £ or more and u/£ = o(l), for any n > we get 

S(^/ c (C/ 1 1)- J B/ c (C7 11 )) 2r 

<C(r)|/ 4 |- 2r E^OS(M)-.ES(M)A 

+ E^2[S(k,i)-ES(k,i)}^j 
< C{r)\Ii\- 2r m a x{{E\S(k,i) - ES(k,i)\ 2r+r ') 2r/{2r+r,) :l<k< Ki] 
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x [l + Ei 2 '" 1 exp(-C(r, n){l + (j - 1)21 - 2u))j {^W 
<C(r,r ? )|/ i rV(^|/c(^il)| 2r+r? ) 2r/(2r+??) 

where an d Y^2i respectively, denote summation over all odd and even 
k, 1 < k < K. L . Now take r\ = 2(q — rs)/s, so that s(2r + rj) = 2q. Then, by 
(A. 3) and Lemma 3.30 of [15], the lemma follows. □ 



Lemma 5.2. Suppose that assumptions (A.2)-(A.4) hold, E\\X\ 



1 4+5 



< 



oo for some 5 > and 1 < £ < m < ra/4. 

(a) For any integer r > 1, if E\\Xi || 2r + 2 +< 5 < c>o for some 5 > 0, then 

max^P(||/i ni j — fi\\ > ra -1 / 2 logra) = o(n~ r m r ). 

(b) For any A > 0, K > and e > 0, there exist N± = N\ (A, e,K)>l and 
C(X,e) > such that, for all n>N\ and for any £ G [4(logn) 2 ,n 1 / 2 ], 

max P(sup{|t& in (t) -w*(t)| : ||t|| < An A } > e,£*||t/ 2 ill < *0 < C(A, e)n~ 2A . 

0<i<M 



Proof, (a) It is easy to check that, for any < i < M, \\fin,i ~ X n \\ < 
{N-m)^{{£ + m)\\X n \\ + t {1 _ M} ^^ 
X n - j+1 )\\}. By Theorem 2.4 of [24] (with s = 2r + 2), 

P(||X n || > C^rT 1 ' 2 (log n) 1 / 2 ) = o{n~ r ). 
Further, using arguments similar to the proof of Lemma 3.28 of [15], we get 

2r 



E 



Y, U 3 



< C(r)(£ + m) 



and 



E 



i-i 



2r 



< C(r)£ 3r . 



Part (a) of the lemma now follows using Markov's inequality and the above 
bounds. 

(b) Let D n = {veZ d : \\v\\ < An 2A }. Then, for any t £ R d with \\t\\ < Xn x , 
there exists a v G D n such that \\t — im _A || < n~ x . Then it follows that for 
all i £ {0,1,..., M}, 

\w in (t) - w in (un- x )\ < n^E^U^W < n~ x K, 

\u>e(t) - we.(vn~ x )\ < n" A J B||C/ 2 i||- 
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Hence, by Lemma 5.1, for all n > N(X, e, K) > 1, and for any t € [4(log n) 2 , n 1//2 ], 
m e [i,n/4], 

P(sup{\w in (t) -Wi(t)\ : ||t|| < An A } > e^E^U^W < K) 

< P(max{|u> in ,(i/ra~ A ) - wi>(vn~ x )\ : v £ D n } > e/2) 

< C(e, r)| A l ||/ i |- 2r £ 2r ^ C ( £ ' A ' ^)n 2Ad (n" 1 £) 2r 

uniformly in i E {0, 1, . . . , M}, where r is an integer > 2X(d + 1). This com- 
pletes the proof. □ 

Lemma 5.3. Let W±, W2, ■ ■ ■ , W n be i.i.d. random vectors on M. d with 
EWi = 0, Cov(Wi) = Id and pw = E\\Wi\\ 5 < 00. Suppose that n > 1 is 
such that oi„ = £||Wi|| 4 l(||Wi|| > 20»/3) < (2 & d)~ l n. Then for any Borel 
set B in W 1 and any e > 0, 



(5.1 



<C(d)(l + pwO 

x [(r^ 3 / 2 ) + (a ln n^ +a^ +5) +n( 2+rf )a+ (d+5)(,i+8) ) 
+ (a n e- 2d + n d+5 e- M exp(- £ - 1 )) + $((dP) 2e )], 

where a 2n = ((1 + p W )n- l ) l/( - d+5) and a n = n d+5 &~ d ~ 5) with £ n = 
sup{|.Eexp(zt / Wi)|: (16E\\ WiH 3 ) -1 < \\t\\ < e~ 4 } + 2P(||Wi|| > y/n). Here 
p 1 (x)(j>(x) = -j: wl=3 (EW?/v\)(D» ( j>(x)) andp 2 (x)<P(x) = j: H =4XAWi) x 
D»4>{x)/v\ + 2- 1 (£ H=3 (^r 1 X,(^ 1 ) J D 



i>\2. 



Proof. The lemma can be proved by carefully recasting the arguments 
and the bounds in the proof of Theorem 20.1 in [3] (cf. [2]). We omit the 
details. □ 

Lemma 5.4. Assume that conditions (A.1)-(A.6) hold, p(r,5) = 
-E||A"i|| 15 ( 2r+1 ) +<5 < 00 and n K < i < k" 1 ?! 1 / 3 and £<m< n 2 / 3 for some in- 
teger r > 1 and constants < k,5 < 00. Then there exist a constant C = 
C(k, 5, r) G (0, 00) and sets Ai n , i = 0, 1, . . . , M, such that, for all n>C, 

max{P(A c in ) : i = 0, 1, . . . ,M} < C[n' r £ r }, 

and on the set A{ n , 

max sup|P«(7^<x)-* ni (x)| < C[b^ 2 + £n- 3 / 2 ](logn) 4 , 

0<i<M x 

where the Edgeworth expansion of T* 1 is defined by relation (5.14) be- 
low. 
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Proof. Without loss of generality, assume that the Xj's and the boot- 
strap variables X* 1 , . . . , X™ are defined on a common probability space 

(Q, P) for all n > 1. For i = 0, 1, . . . , M define the set as the intersec- 
tion of the sets {\\t n>i - < (2HEJ 1 H)" 1 }, {\r 2 ti - rj\ < r|/2}, {||An,i - 

HI<<$m~ 1/2 logn}, {^ll^illl 10 ^^ 1 },!^^!) 3 !^^- 1 }, and {||3^ - 
E t \\ < (2||(S^)" 1 ||)" 1 }, where < 6i < 1 is such that £||^oc|| 10 < (2<5i)-\ 
\im nr ^ 0O 'E M=3 \n 2 EX^\ < (25 1 )~ 1 and inf{E|«|=i \D a H(x)\ : \\x - fi\\ < 
25\} > S\. In the steps below, unless specifically mentioned otherwise, the 
bounds in the inequalities hold uniformly in i £ {0, 1, . . . , M}. 

Step I (Stochastic expansion). First we derive a stochastic approxima- 
tion to T*\ For this, define the set A* n as the intersection of the sets (involv- 
ing both the X,'s and the Xf's) {\\X* - An,i|| < Sm' 1 / 2 log n}, {Rr* 4 ) 2 - 
t 2 \ < fJ/A} and {\V* % \ < C{5i)n l / 2 b~ l / 2 \ogn} . Then, using Taylor's expan- 
sion, we have 

3 

(5.2) yfc{H{X«) - #(/}„,*)) = Vn~ £ M^n - An,i) Q + R&> 

\a\=l 

{<? - f 2 , = b- 1 £ [(y^) 2 - f 2 j + n- l/2 v^ - £(F«) 2 

(5.3) +n- 1 /2 6 - 1 /2 Al (Z«;{c Q : |a| = 1}) 

+ n- 1 A 2 (Z 2 t;{c Q , i :|a| <3}) + i?«, 

where, on the set j4| n n , the remainder terms admit the bounds (uni- 
formly in i) 

(5.4) |^«|<C(«5 1 , J D^)7i- 3 / 2 (logn) 4 , 

(5.5) \Rf n \ < G^, Z^n" 3 / 2 (log n) 3 . 

In (5.4) and (5.5) D H = sup{\D a H(x)\ : \a\ < 3,\\x - fx\\ < 2Si} + 
sup{(T,^ = i\D a H(x)\)~ 1 : \\x — fi\\ < 2S\}. Next, using Taylor's expansion of 

the function g(x) = x~ 1 / 2 around x = f 2 i , and using (5.2) and (5.3), we get 
Vnl(H(X») - #(£„,))/«* + n" 1 ) 

3 

1/2 - / -1/2, 



\a\=2 

x[f- J 1 -(2f 3 i r 1 {« l ) 2 -r 2 J 
+ mL)- l {{<l 2 -rl l } 2 + R^ 
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3 \-ir„-V2/ 



+ 3(8f n 5 i )- 1 nr 1 R* i } 2 ] 



+ n^ 1/2 2 c a , J (Zr) Q /f n , l + n- 1 / 2 6- 1 / 2 A 3 (Z 2 «;i? n , l ) 



M=2 



+ n- 1 A 4 (Z«; J B nii ) + J R^ 
where B n>i = {c Qji : 1 < \a\ < 3} U {/}„,,} U {f" 1 }, and by (4.3), (4.4) and 



(4.5), on the set A* n nA\ 



(i) 



(5.7) 



\Rg\ < C(5 1 ,D H )\(r* i f - f 2 / < C( ( J 1 , J D H )6- 3 / 2 (log 
\Rt | < C(<Ji , D H ) [^" 3/2 (log n) 4 + 6- 3 / 2 (log n) 4 ] . 



n) 



Here, gives the desired stochastic expansion for the Studentized statis- 
tic T* % . Note that T-j*^ is a polynomial in the do-dimensional i.i.d. random 
vectors Wf = \E n ^ l/2 {U^ - E,U$)J = 1, .... 6. 

Step II (Edgeworth expansion for T*^). Note that conditional on X n , 
U%[, . . . , U^l are i.i.d. random vectors with covariance matrix S n ». Also, on 
the set j4$, exists and ||S~J|| < 2 1 1 1 1| . Hence, taking Wj = W*\ 
j = 1, . . . , b, and e = 6~ 2 in Lemma 5.3, for all n > Ni = Ni(5i,k) (not de- 
pending on i or i) we find that, on the set A\ n ' , 

< C(^)[6" 3 / 2 + a n ,^ 4d + <Z>((dB) 2e )] 

for all Borel sets B in Here a nj j and pk,i are as in Lemma 5.3 under the 
given choice of Wj's. Using the bounds on ||H~*|| and ||f7*||| 10 on , 
for all n> Ni, on the set A^ , we get 

&n,i < fe d+5 [sup{|cD nii (t)| :Ci < <C 2 (<5i,k)6 8 } 

+ C(5 1 , K )6- 5 / 2 ]( fc - d - 5 ) 

= ^ +5 [ln,i + C(<5i, K )&- 5 / 2 p- d - 5 \ say. 



Let = sup{ \E exp( V— c 

,(2) 



Next define the set A% = {^ n ,i < £00 + [1 - £oc]/2} and let A in = ^ n A£> . 



> Ci(5i,k)}. Note that < ^ < 1. 

Wo 4(2) 
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Then for all n > N2(6\, k, £oa), on the set A{ n , we get 

b~ k/2 p k , 



(5.8) 



<C(,5 1 , K ,eoo)r 3/2 + 1>((5 J B) 2e )] 



for all Borel sets P in M rfo . Next note that there exists a constant C = 
C(5i,k) > such that, for all n > C, ||[En,i] _1 || + E *\\ U n\\ 4 < C on the 
set Ai n . Hence, by (5.8) we get the following moderate deviation inequalities: 
For all n > 1, uniformly in i = 0,1, ... , M, on the set Aj n , 



(5.9) 



(5.10) 



P* 



>C6 1/2 logn <Cb~ 3/2 , 



P*(||X^ - An,i|| > Crr 1 ' 2 log n) < Cb" 



3/2 



where the second inequality follows from the first by noting that y/n± (X* 1 — 
/} nji ) = ^6 =i NoW; by ( 5 9 ) and ( 5 10 ) it foii ows that, for all n > 1, 

on the set A in , 
(5.11) 



PMT n )<Cb-^. 



Let = 6" 1 Ei=i W/*- Note that the stochastic expansion Pf* in (5.6) 

can be written as 2?* = ELo V(V^T; {An.*. S„,i}) + n^ 3 (V^WT; 

Sn,i}) for some suitable functions qk(ui;{x,E}),k = 0,1,2,3, where 
each qk{oj; {x, E}) is a polynomial in a; £ M do with coefficients that are con- 
tinuous functions of (x,3) in a neighborhood of (//, Eqo). In particular, the 
functions q^'s do no£ depend on i and n. Since on Ai n Y^\ a \=i \ D a H{ji n + 
x)\ > C((5i) for ||x|| < Si, by applying the transformation technique of Bhat- 
tacharya and Ghosh [1], and recasting their arguments on pages 434-435 for 
the last term above, one can show that, for all n > N% = Ns(Si, K,£oa) ( n ot 
depending on £ and i), on the set Ai n , 



(5.12) suplP^P^ <x)-*n,i(s)| <C(5l,K,D H )[lri 



-3/2 



+ 6- 3 / 2 ](log 



n) 



where the expansion ^> n ,i is defined through the transformation of the Edge- 
worth expansion of ?r 1/2 £?=i Wf in (5.8). This completes Step II. 

Step III (Form of ^l n j). We now identify the terms of ^ n ,i by com- 
puting the approximate cumulants of Pj^. The validity of the resulting ex- 
pression follows by recasting the arguments of Bhattacharya and Ghosh [1] 
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to the present setup. Let x* (£*) denote the conditional cumulant of order 
r > 1 of a generic bootstrap variable S*, defined as 



(^T) r X [ : ] (S:) = |_log^exp( v ^Tt / 5;) 



at 



t=0 



Next note that, for any zero mean i.i.d. random vectors Wj = (W\j, . . . , Wgj)', 
j = !,..., J, 



k=l\j=l / \k=l / 



k=l \j=l i 



JE J] W kj + J(J - l) £ EWi (I)EWi (I c 

\k=l / (4) 



(5.13) Ejl 

fc=i \j=i / 

6 / J > 

fill 

/c=i \j=i / 



JE\ ' \ W kl ) + J(J - 1)J2EW 1 (I)EW 1 (I C ), 



,k=l 
■ 5 



(5) 



n^i +j(j-i)^wi(/)wi(/ c ) 

V fc=l / (6) 
** 

+ J(J-l)(J-2)J2EW 1 (Ii)Wi (/ 2 )Wi ( J 3 ) , 

(6) 

where for a > 4 S( a ) extends over all distinct partitions {I, I c } of {1, . . . , a} 
with |I| = 2, X)(a) extends over all distinct partitions {I\,l2, 13} of {1, . . . , a} 
with |ii| = I/2I = l-^l, and where for any set J C {1, ... , 6} W±(I) = Ilfce/ Wfcl- 
Now, using the identities in (5.13) and the bounds on the bootstrap moments 
on the set Ai n , after some tedious algebra one can show that 



xl 1] (T«) 



l7l=l 



+ n- 1 ' 2 £ £a,iE*(U$) a /f nji + Q 



[1] 

n.i 



X l 2l (T 1 t) = l + 36- 1 +QS, 



\a\=2 

[2] 



say, 
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+ 2{EjfZi{U{{) a E*YZi {Utlf}] 

= J-v [Z] + 6 [3] sav 
xfe) = -^T^^it) 4 + y + 05 - ^xfi + Q% say, 

where, for some -/V 5 (<5i) > 1 and C{8\) 6 (0, oo), on the set ^4j n , X)fc=i lOlf i ~~ 

^-^^({^(^l) : M < 4}; B nM < C(5i)^ 3/2 uniformly in i = 0, 1, .' . . , 
M whenever n > (<5i ) . Hence the Edgeworth expansion for T*^ is given 
by 

* n|i (x) = - (xg + ^ 2 (x)xl 3 l) 
(5-14) - b-^Hiix) + ^(aOxij)^) 

5 

+ n~ l ]T A 9+K ({E*(UZ{) a : \a\ < Q;B nji )H k (x)<j>(x), 

k=0 

where H^{x) denotes the kih order Hermite polynomial, k > 1. 

We now complete the proof of the lemma by deriving the desired bound 
on P{A c in ), < i < M. By Lemmas 5.1 and 5.2, for all n > N 6 (k, <5i), 

P(4n C )<P(\\i>n,i- /x||>n- 1/2 logn) 

+ 2 P(VWE/?j) - Wi| > c(5i)) 

|a|=3 
10 

|a|=2 

< C(5i,p(r,5))[o([n- 1 m] 5r ) + (v / £) 6r (n- 1 £) 3r + n" r r] 
<C(<WM))rr r F 

uniformly in i G {0, 1, . . . , M}. 

Also, by Theorem 2.8 of [15], for any 5 2 > 0, K > 0, there exists Nj(k) > 1 
such that, for all n > N 7 (k), sup{|£ , exp(it / C/ 2 i)| : S 2 < \\t\\ < £ K } < 
supd^exp^t'^oo)!:^ < ||*|| <e K } + C(5 2 ,K)£- 1 / 2 log£ uniformly in n K < 
£ < K~ 1 n 1 / 3 . Hence, by Lemma 5.2 (with A = max{8,r/2}) there exists an 
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integer = Ng(r, k, 5\, £00) > 1 such that, for all n > N$, 

P(L,i > Coo + 2" 1 (1 - £oo), £.||021 II < C ( 6 l)) 

< P(sup{|^exp(^/^Tt / C/ 2 * 1 ) - Eexp(V^lt'U 2 i)\ : ||t|| < C(5i,A;)n 8 } 

>(i-e o)/4,£;*||c/ 2 * 1 ||<c(5 1 )) 

<C(r,0 QO )rr r . 

Therefore, it follows that P(A% n ) < C(r, K,8i,£ <00 )n~ r i r for all n > max.{Nj :j ■■ 
1, . . . , 8}, proving the lemma. □ 

Proof of Theorem 3.1. First we simplify the leading terms in the 
Edgeworth expansion of T* % further. By Taylor's expansion of = 
D a H (£i n ,i) I ol\ around fx, on the set Ai n , we have 



E*{Y»f =eJj2 t^mir - E*uzi)) 

\\a\=l / 



v|a|= 

(5.15) = #4ni] 3 - 3(^ni)(^(ni) 2 ) 

+ E E C({c J :\ 1 \<2})E*(U&«+Pfi nti + R¥l, 

\a\=2\f3\=l 

where \Rii n \lA in < Cn^VI^ogn) 2 for all < i < M. Next define the sets 

4? = iKi ~ T e\ < b~ 2/5 } and D i>n = (A 0n nA m )n (A® n 4$ ) , < i < M. 
Then, using Lemma 5.1 and Chebyshev's inequality, one can show that, 
under the conditions of Lemma 5.4, 



(5.16) max P(Df n )<C(n 

\ ) 0<i<M y l ' n/ ~ X 



Next, using Taylor's expansion of fj £ = (f 2 n ) a l 2 around tJ and (5.15), 
after some algebra one can show that the Edgeworth expansion of T* 1 may 
be rewritten as 

V n>i (x) = $(z) + -= — ±-Ve[E,(T£f - ZTlE*T*i\4>{x) 
+ 4=Ai 8 ({t)'S(a) : 1 < |«| < 3}, {/in.i}, B; x)<f>(x) 



n 



(5.17) +6- 1 Ai 6 ({C/ 1 i ^(a):l < \a\<4},B;x)<f>(x 

+ n- 1 A 17 ({U 
= ^l(x) + Rfl(x), say, 



+ n- 1 Ai 7 ({f7S(a):l< \a\ <8},B;x)(j)(x) + R^ n (x) 
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where B = {c a : \a\ < 3} U {r^ 1 } U {EU& : 1 < \a\ < 8}, and on the set £> ijfl) 

|i?j§ n (x)| < C[fe~ 3 / 2 + n" 3 / 2 £](logn) 4 for all < i < M,xE R. Further, each 
term of the polynomial A15 involves the product of at least two terms from 
the collection {u[^(a) : 1 < \a\ < 3} U {fi n ,i}- 

Next we find an expansion for Var((^i„). Set Yi n = <£(x) + ^ g~ir^ x 
[^(n?) 3 - 3r/ (^•n?)]^)- Then, by Lemmas 5.1, 5.4 and (5.16), 

|Var(<^i„) - Var(f i n l Do n )| 

< 3P(£»g in ) + VarQ^m - f ln ]t Do J 
+ 2|Cov(f ln t Do n , (0 ln - t ln )l Da J\ 

< C[P(Dl n ) + {Var(f ln l A) , J} 1/2 {^" 2 n V2 ]- 



(5.18) 



Using the arguments develped by Hall, Horowitz and Jing [20], one can show 
that 

(5.19) Var(f ln ) = Ct^{2x 2 + l) 2 4? {x)n~ 2 I 2 (1 + o(l)). 

Also, by Holder's inequality and Lemmas 5.1 and 5.4, 

E(t ln t D c J 2 < 2(P(T ln - Et ln ) 2 l D c n + (PT ln ) 2 P(Z^ n )) 

< C[{E(f ln - £Ti n ) 4 P(L>o,n)} 1/2 + (n-^Ppg.n)] 

< C[{n- 1 ^(n- 1 ^) 2 (n- 1 £) 3 } 1/2 + n^n" 3 ^] < Cn" 3 ^ 3 . 

This implies that | Var(f i n l_D J - Var(f ln )| < C^n" 5 ^ 5 ) 1 / 2 an d, hence, 
from (5.18) and (5.19), 



(5.20) 



Var(0 ln ) - Var(f ln )| < Cn~ 2 £ 3 / 2 . 



Next we prove convergence of the JAB variance estimator. Let Wkj = U 
EU^ for some a k G Z% with 1 < \a k \ < 8, k = 1, . . . ,r, 1 < j < N. Also, let 
S n (k,i) = Ejeii W kj- Then, for 1 < i < M, 



m 



Nl[S n (k,0)-(N-m)Y[S n ( 



k=l 



k=l 



■k-l 



e dam) n 



k=i ( P =i 



<p=k+l 



m- 1 E W kj 



Note that, by Lemma 5.1, max{ES n (k, i) 2 : < i < M, 1 < k < r} < Cn~ x l, 
and by similar arguments, max{P(m _1 Wkj) 2 ■ 1 < i < A/, 1 < < r} < 
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CmT x t. Further, on the set D i>n , \S n (k,i)\ < C for all < i < M, l<k<r. 
Hence, using the Cauchy-Schwarz inequality, for r > 2 we have 

M 

i=l 

r fk-1 \ / M t \ 1/2 

<e n^°) m_i e n s 2 n ( P ,i)t Di A 

fc=l lp=l J \ i=lp=fc+l / 

/ M ( \ 2x1/2 

(5.21) x M- 1 ^: U- 1 ^^ 

V i=i\ jjj/, / / 

r fk-1 } 

fe=i i P =i j 

M \ 1/2 / M / \ 2\ 1/2 



' M \ / M / \ A 

(7(r)M-^^(p,i) ^Er"^^' 

v i=l / V i=l V j^Jj / / 



= O p {{n~ 1 i) 1 l 2 {m~ 1 t) l l 2 ). 

And for r = 1 there exist weights u;j n G [0, 1], 1 < j < N, such that 

M M / \ 

i=l i=l V j^/j / 

(5.22) 

JV 

= M-^^jnWkj = O p (n- l £), 
i=i 

by arguments similar to Lemma 5.1. Let VARi n = (m/N)M~ l J2i=i(^in( x ) ~ 
*m(x)) 2 tD, n and A ln ee (m/N)M^ [(<^£ " " (*£ (*) - *m(*))] 2 x 
l DiiJi , where *£(x) = m -1 ^*^^) - (TV - m)*£(x)], 1 < « < M. Then, 
using the fact that </?£ — (p\ n = [(N — m)/m](0i n — <fi„), 1 < i < M, 

|vSjab(^i„) - VARi„| < [A ln + 2(VAR 1 „) 1 ' 2 (A 1 „) 1 ' 2 ] 
(5-23) + =M-g(^) 2 (fc-^)H D ., 
By Lemma 5.4 and (5.17), it readily follows that 



m ( N — m 



2 M 



''in 

1=1 



Am < ^ ( ^ ) M- 1 - K(^)) " (#2 " V 
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(5.24) < C- [(n- 3 / 2 £ + &- 3 / 2 )(log n) 4 ] 2 
m 
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< Cn- 2 e 2 [m~ 1 e(logn) 8 ]. 

Since \<pf n - tp ln \ < 1 for all i and by Lemma 5.4, M" 1 p ( D in) ^ 
C[n- l £f, by (5.18)-(5.20), (5.23) and (5.24), it is now enough to show that 



(5.25) 



|VAR ln -Var(T ln )|= 0p (n- 2 ^ 2 ). 



To that end, define the variables T 2j = [n -1 ^] 1 / 2 ^ 3 )~ 1 (2x 2 + l)(p(x)[Tl j 



37frij], l<j<N. Then from (5.17) we have tf&Cs) = $(x) + \Ii\~ 1 x 
J2jei t + Ri3n( x )' — * — w here l?kj n (:c) is the sum of the terms in- 
volving Ai5,Aia and A17 in (5.17). Write .R^Jx) = m- 1 {N R^x) — (N - 



m) 



R { $ n (x)),f 3l = m- l Y Jm (T 2j -ET 2l ), l<i<M, and f 3n = iV^Sf^^ 



£T2i). Then it follows that 



*g(*)-*i>)=r 



(0), 



3i 



f3n + £g n (s) 



i? 



(0) 
13n' 



1< i < M. 



Using this identity and noting that Var(Yi n ) = Var(T3 n ), one has 
|VAR ln -Var(f ln )| 



< 



(5.26) 



-. M 

YXR ln _!^._Lyf 

N 



+ 



m 1 



M 



N M * 



i=l 



+ 



m 



31 



Var(T 



= / n +/12 + /13, 



3)( , 



say. 



Clearly, I 13 = AT 1 ! Var^-Va ^ r 2i )- Var^-V* r 2i )| = o{n~ 2 l 2 ). 
Also, by arguments similar to the proof of Lemma 5.1, for any < 77 < 1, 



EI 2 2 < C ■ 



<C- 



(5.27) 





2 


m" 


M~ 2 


N. 






2 


~ m~ 






M~ 2 


N. 






3 


3 n~ 


max 




|a|=l,3 












iff 







M 



max 



+ m i<k<e+m 
M 





k 




(■ 


i=l 


2+77^2/(2+7?)- 



£ + m 



(£ + m) 2 (^|f 3 i| 4+2r ') 2/(2+r ' ) 



"E 



A l/2 



/I 



(Eft 



( m -V) 2 = Cn- S ml 4 . 
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Next let A 2n = ^[m" 1 E^i R\^D in + f | n + {££? n } 2 ]. Then it is easy to 
show that 



In <C 



(5.28) 



A 2n + (A 2n )^{^M-^l 



M 



1/2' 



t=l 



M 



By (5.19), (5.20), (5.26), (5.27) and the bound on I 13 , f - Af _1 Ei^i f ii 
O p (n~ 2 £ 2 ). Also, using arguments similar to (5.27), one gets 



{M ~\ M 



c v\l/2 



(5.29) 



~ N 



n \m 



1/2 



n 



-3^31 1/2 



o(n-H 2 ) 



Finally, using (5.22), (5.23) and Lemma 5.1, on.6 CEin show that ^2n — 
o v {n~ 2 £ 2 ). Hence, (5.25) now follows from (5.26), (5.28) and (5.29). This 
completes the proof of Theorem 3.1. □ 

Proof of Theorem 3.2. The proof is very similar to the proof of 
Theorem 3.1. Hence, we point out the necessary modifications. Using the 
arguments in the proof of Theorem 20.1 of [3], one can derive a version 
of Lemma 5.3 with a remainder term of the order o(n~ 3 / 2 ). Next, using 
arguments similar to the proof of Lemma 5.4, on the set Ai n , one can derive 

" (i) 

a fourth-order Edgeworth expansion Vl/^, say, for the Studentized statistic 
T** with an error term o(n~ 3 / 2 ) uniformly in < i < n. Here the 0{n~ l l 2 ) 

terms of Vf^ are the same as those given by Lemma 5.4 with £ = 1 = m. 
Hence, it follows that Var(c^i n ) ~ Cn~ 2 for all xq £ M, which goes to zero 
at a rate faster than Var((^i n ) in the dependent case. This is why we needed 
a more accurate Edgeworth expansion in the independent case than the 
dependent case. 

Next note that, by Corollary 4.4 of [12], for any i.i.d. random variables 
Wi,...,W n with EW X = and E\W^ < 00 for some t E [2, 00), 



P El^l <Ci(t)[nE\Wi 



(5.30) 



.i=i 



+ exp(-C 2 (t)x 2 /[n Var(Wi)]), x > 0. 
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Now using (5.30) and moderate deviation probability inequalities (cf. [3]) 
for sums of independent random variables in place of Lemmas 5.1 and 5.2, 
one can complete the proof of Theorem 3.2 by retracing the steps in the 
proof of Theorem 3.1. □ 

Proof of Theorem 3.3. Let z a denote the a-quantile of iV(0,l). 
Then, inverting the Edgeworth expansion of T* 1 , given by Lemma 5.4 and 
(5.17), we have 

-(*) _ \/l (2zl + 1) (r *j,3 2 Fr *ii 
^ 2n ~ a ~~^ — 0^3 — n) ~ 6T i tj * l ii\ 

+ n~ 1 / 2 A 18 ({U^ (a) : 1 < \a\ < 3}, {/}„,;}, B; z a ) 
+ b- 1 A 19 ({U^(a):l<\a\<4},z a ) 

+ n- 1 / 2 b~ 1 / 2 A 20 ({uS(a) : 1 < |a| < 4}, {/x n>i }, B; z a ) 
+ n- 1 A 21 ({?7 1 ( ; ) (a) : 1 < \a\ <8},B; z a ) + B%} n 
= ^l + ^L say, 



(5.31) 



where, on the set D in , \R^ n \ < C[rT z l 2 t + 6~ 3 / 2 ] (log nf for all < i < M. 
Write f g = z a - ^^[^(Hl) 3 - ZrfEJ'ft], < i < M. Then 

I Var(^n) - Var(f 2n )| < E(ip 2n - T 2n ) 2 

(5.32) 

+ 2[ J B(^ 2n -f 2n ) 2 ] 1 / 2 [Var(f 2n )] 1 / 2 . 

Note that for any random variable W and < a < 1, if PdVFj > Co) < 
min{a, 1 — a} for some Co E (0,oo), then its a-quantile w a satisfies the 
inequality \w a \<Co- Since ||/in,i|l ^ ^"^^H^nll, by Taylor's expansion 
and assumption (A.l), for < i < M and to £ (0,oo) we have 

P*(\I?\ > to) < to 2 E*(T») 2 < to 2 n 3 E.[H(X?) - H{^)] 2 



<tQ 2 n 3 C(d, a) 



[\a\=l 



■H 



2i 2 



+ £4(i + \\x* n T + \\M\ a )K -find 2 } 



< tQ 2 n 3 C{d, k, a^n^fli + n" 2 {l + E, \\U& || 4+2a }] 

< tQ 2 n 2 C(d, k, a)[l + E* \\U$ || 4+2a ] < min{a, 1 - a}, 



(5.34) 
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provided t > Cn{\ + ^||C/ 1 i|| 4+2a } 1 / 2 for some C = C(d,K,a,a) G (0,oo) 
independent of i. Hence it follows that 

(5.33) vf n <Cn{l + E4U{it +2a } 1/2 for all < i < M. 
Now, using Holder's inequality and Lemmas 5.1 and 5.4, we get 

< E0j n l D c n + ET 2 2n l D c b + E(<p 2n - T 2„) 2 1d () ,„ 
<Cn 2 [(l + J B||C/ 11 || 4 + 2a )P( J D^) 

+ {p(^||^ 1 || 4+2a -ii;||c/ 11 || 4+2a ) 12 } 1 /i2 { p (jD ^j } ii/i2 ] 

+ C(D H , z a ,K)b~ l max^l^^n?)^!^ :k = 1, 3} 
+ C[n- 3 £ 2 + fe- 3 ](logn) 8 

< Cfi a [P(J38,„) + {(n- 1 ^) 6 } 1 / 12 {P(iPo c in )} 11/12 ] 

+ C(D H , z a ,K)b~ l maxKETl^iPiD^)} 1 / 2 :fc = 1,3} 
+ C[n- 3 £ 2 + &- 3 ](logn) 8 
= o(n- 2 £ 2 ), 

which, in view of (5.32), implies that Var((^2 n ) ~ Cn~ l £ 2 (l + o(l)). Thus it 
is now enough to show that 

(5.35) |VarjAB(^2„.) - Var(f 2n )| = o p {rT 2 t 2 ). 

For this define the variables VAR,2 n and h. 3n by replacing W^ n {x) \ and <p±n s 
in the definitions of VARi n and K\ n by ^ 2 n' s an d &2n s -' respectively Then, 
by (5.31), A 3n < Cn _2 £ 2 (m _1 .£(logn) 8 ), as in (5.24). Also, writing U 3i (a) = 
E*\\Utlt +2a - P||f/ n || 4+2a , we have E\U 3i (a)\l Dln < {E\U 3l {a)\ 12 ) 1/12 X 
[ p ( D i,n)} 11/12 < Cn" 6 ^ uniformly in 1 < i < M. Hence, by (5.16) and (5.33), 

M / AT \ 2 



N 



< Cm- 1 nHr 1 Y, { ( i + 1 1 u*u 1 1 4+2a + E, 1 1 C7« 1 1 4+2a } % 



n 

(5.36) < C— 

m 



8=1 

3 " 



(l + ^ll^f+^ + PllC/nl 
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I 1V1 

+ ^ElM«)l%,„ 

i=l 

= Cm- 1 n 3 [O p (l)Op((n- 1 ^) 6 ) + O p ((rt) 6 )] = o v (rT 2 l 2 ). 

Therefore, using (5.36), the bound on and arguments similar to (5.23), 
one gets |VarjAB( ( /?2n) — VAR,2 n | = o p (n~ 2 £ 2 ). Now, retracing the steps in the 
proof of (5.25), one can show that |VAR,2 n — Var(T2 n )| = o p (n~ 2 £ 2 ), which 
yields (5.35). This completes the proof of Theorem 3.3. □ 

PROOF of Theorem 3.4. Note that in the i.i.d. case, I = m = 1 im- 
plies that N = M = n and hence, U 3i (a) = || 4+2a - E\\Uu || 4+2a = 
l^l" 1 Eie/ i (ll^j| 4+2a " E\\X 1 \\ i+2a ), where I = {l,...,n} and I l = I \ {i} 
for 1 < i < M. Since the Aj's are i.i.d., U 3 i(a) has the same distribution as 
U 3 \{a) for all 1 < i < M. Now, using (5.30) with t = 7.5 and using Theo- 
rem 3.21 of [14], we have 

E\U 3i (a)\t Dln < {E\U 3i (a)\H(\U 3i (a)\ > |/ 4 |- 1/2 logn)} 1/4 [P(^ n )] 3 / 4 

+ {|I l |- 1/2 logn}P(^ n ) 
<{o(n^ 1 )} 1 / 4 {C n - 6 - 5 } 3 / 4 + C{n^ 1 /2 logy^n" 6 - 5 
= (n~ 5 ), 

uniformly in < i < M. The proof of the theorem can now be completed by 
combining the arguments in the proofs of Theorems 3.2 and 3.3 and using the 
above inequality in verification of (5.34) and (5.36). We omit the routine de- 
tails. 

□ 
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